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Abstract 

'^ ■ We consider an experiment with two qualitative factors at 2 levels each and 

a binary response, that follows a generalized linear model. In Mandal, Yang 
'^ \ and Majumdar (2010) we obtained basic results and characterizations of lo- 
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cally D-optimal designs for special cases. As locally optimal designs depend 
on the assumed parameter values, a critical issue is the sensitivity of the de- 
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Q>^ . sign to misspecification of these values. In this paper we study the sensitivity 



theoretically and by simulation, and show that the optimal designs are quite 
robust. We use the method of cylindrical algebraic decomposition to obtain 
locally D-optimal designs in the general case. 
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1. Introduction 

We consider experiments with two qualitative factors at two levels each with 
binary response, and investigate the robustness of the /^-optimal allocation 
of replicates. Binary responses are usually modelled using generalized lin- 
ear models (GLMs). GLMs have been used widely for modelling the mean 
response both for discrete and continuous random variables with an empha- 
sis on categorical response. Although the methods of analyzing data using 
these models have been discussed in depth in the literature (McCullagh and 
Nelder (1989), Agresti (2003)), only a limited number of results are available 
for the choice of optimal design of experiments under GLMs (Khuri et al. 
(2006)). Recently Mandal, Yang and Majumdar (2010) obtained some theo- 
retical results for locally D-optimal 2^ designs in some special cases. Recall 
that Fisher's Information matrix contains the unknown parameters, and so 
does the D-optimality criterion. As we consider the locally optimal designs, 
a critical question is how to choose the initial values of the unknown pa- 
rameters, and also to investigate the robustness of the optimal designs with 
respect to misspecification of the values of the parameters, an issue which 
was briefly mentioned but not explored in details in our earlier parer. In 
this paper, we obtain theoretical as well as numerical results on the optimal- 
ity of 2^ designs. We investigate thoroughly the robustness of designs, with 
particular emphasis on the uniform {i.e., equireplicate) design. 

The optimality criterion can be written in terms of the variances, or infor- 
mation, at each of the 2^ points. Note that these variances depend on the 
parameters through the link function. It turns out that the D-optimal design 
can be quite different from the uniform design, especially when at least two 
of these variances are far from each other. 

Our results can be described as follows. If the experimenter has reliable 
knowledge of the variances then the design obtained by using the cylindrical 
algebraic decomposition (CAD) technique discussed later results in a highly 
efficient design. If the experimenter has some approximate knowledge of 
those variances, then using our results, efficient designs can be obtained. In 
the absence of any prior idea of the variances our recommendation is to use 
the uniform design, which is the most robust one in general. It may be noted 
that for applications where a D-optimal design cannot be used, it can still 
serve as a benchmark to evaluate other designs. 



For illustration suppose we have a linear predictor involving two factors, 
namely, family history (xi) and physical exercise (X2), which leads to the 
linear predictor rj = Po + PiXi+/32X2- If we have sound reasons to believe that 
family history is a much more dominant factor than exercise, and on the basis 
of prior knowledge, an initial choice of parameters (/3o, /3i, (32) = (2, 2, 0.05) is 
reasonable, then the optimal allocation of 100 experimental units using the 
CAD method will be (6,28,33,33). One the other hand, if the practitioner 
decides to use the popular uniform design, then the relative loss of efficiency 
is approximately 5%. 

This paper is organized as follows. In section 2 we give the preliminary 
setup and some relevant results from Mandal, Yang and Majumdar (2010). 
The cylindrical algebraic decomposition technique to solve the general D- 
optimality problem for 2^ experiment will be discussed in section 3. In sec- 
tion 4 we discuss robustness of the D-optimal designs both theoretically and 
numerically. We study the robustness of uniform design as well as a real 
experiment in section 5 and conclude with some remarks in section 6. All 
proofs are relegated to the appendix. 

2. £)-optimal 2^ Designs: Preliminary Setup 

Consider a 2'' experiment, i.e., an experiment with k explanatory variables 
at 2 levels each. Suppose the proportion of units allocated to the ith exper- 
imental condition is Pi, such that Pi ^ 0, i = 1, . . . ,2^, and YlPi ~ 1- ^^ 
this paper we consider the problem of finding the "optimal" p^'s. Let rj be 
the linear predictor for the chosen model. For instance, in a 2^ experiment, 
V = /^o + l^iXi + (32X2 + (33X3 + (323X2X3 represents a model that includes all 
the main effects and the two-factor interaction of factors 2 and 3. The aim of 
the experiment is to obtain inferences about the parameter vector of factor 
effects (3; in the preceding example, (3 = {(3o, (3i, (32, (33, (323) ■ 

In this paper, we consider the 2^ experiment with main-effects model, which 
gives r] = (3o + (3iXi + (32X2 and (3 = ((3q, (3i, (32) . Here the mean response /j, 
is connected to the linear predictor rj by the link function (McCullagh and 
Nelder (1989)). 

The maximum likelihood estimator of (3 has an asymptotic covariance matrix 
that is the inverse of nX'WX, where W = diag {wipi, ...,W2kP2k), Wi = 



i'd^) /(/^*(-'- ~ l^i)) ^^*^ -^ is ^^^ "model matrix". For example, for a 2^ 
experiment with main-effects model, X = ((1, 1, 1, 1)', (1, 1, —1, —1)', (1, —1, 
1, —1)')- The D-optimality criterion maximizes |X'VI^X| where p is the 
number of parameters in the model; in this case p = 3. In the rest of this 
section, we will give some basic ideas and results developed in Mandal, Yang 
and Majumdar (2010). 

For the 2^ experiment with main-effects model, the optimization problem 
maximizing |XWX| '^ reduces to maximizing 

dei(w,p) = 16wiW2W3W4L{p), 

where w = {wi,W2,W3,Wi)', p = (pi,P2,P3,P4)', 

L(p) = V^PiP2P3 + VSP1P2P4 + V2PlP3Pi + ViP2P3Pi, (1) 

and Vi = 1/wi, i = 1,2, 3, 4. Assuming Wj > for i = 1, 2, 3, 4, we consider the 
problem of maximizing L{p) over all vectors p with Pi > and YliPi ~ ^■ 
Although the objective function ([T]) is elegant, an analytic solution with 
general fj > is not available. Mandal, Yang and Majumdar (2010) proved 
the following results. 

Lemma 2.1. If vi > V2, then any solution maximizing L{p) must satisfy 
Pi < P2; if Vi = V2, then any solution must satisfy pi = p2. 

Theorem 2.1. L(p) has a unique maximum at p = (0, 1/3, 1/3, 1/3) if and 
only if vi > V2 + V3 + V4. 

Note that this does not correspond to a complete 2^ experiment, rather it 

corresponds to a design supported only on three points, which is saturated 

for the main effects plan 77 = /3o + f^iXi + /32X2. Theorem 12 . 1 1 reveals that the 

D-optimal design is saturated if and only if 2 maxj Vi > V1+V2 + V3 + V4, that 

is, 

2 1111 

—7 7 >— + — + — + —. 2 

mmjwi, W2, W3, W4I Wi W2 W3 W4 

We call ([2]) the saturation condition. This condition will play a crucial role in 
our robustness study. We defer the discussion on the importance of condition 
until section 4. We also need the two corollaries listed below in the robustness 
study. 



Corollary 2.1. Suppose f 2 = f 3 = f 4 = f and vi < 3v. Then the solution 
maximizing (J\) is 

3v — Vi 2v 

Pi = 7^ , P2=P3= Pi 



9f — vi 9t; — vi 

with the maximum L = 4i;^/(9t' — Vi^ . 

Corollary 2.2. Suppose t"! = t'2 = u, ^3 = ^4 = v, and u > v. Then the 
solution maximizing (J\) is 

2u — V — d u — 2v + d 

Pi=P2 = -^7 ^, P3=Pi = -77 ^ 

b[u — V) b[u — V) 

with the maximum L = (2m — v — d){u — 2v + d){u + v + d)/ [108(m — vY], 
where d = \Ju^ — uv ^ v^ . 

3. Exact Solutions Using Cylindrical Algebraic Decomposition 

Since analytic solutions for the optimization problem in ([1]) is not available, 
in this section we will investigate computer-aided exact solution. One option 
is to use the Lagrange multipliers or the Karush-Kuhn- Tucker (KKT) condi- 
tions (Karush (1939), Kuhn and Tucker (1951)). It leads to intractable poly- 
nomial equations. Another option is to use numerical search algorithms such 
as Nelder-Mead, quasi-Newton, conjugate-gradient, or simply a grid search 
(for a comprehensive reference, see Nocedal and Wright (1999)). Those nu- 
merical methods are computational intensive in general when an accurate 
solution is needed. We suggest using the cylindrical algebraic decomposition 
(CAD) algorithm to find the exact global solution. 

Fotiou et al. (2005) gave detailed description of using CAD for general con- 
strained optimization problems. Our optimization problem (|T]) is associated 
with the so-called boolean expression: 

{L3-f> 0) /\{p, > 0) /\{p2 > 0) /\(P3 > 0) /\{pi +P2+P3<1) 

where L3 = L{pi,p2,P3, 1 — pi —p2 —P3), and / is a new parameter indicating 
the value of the objective function. Given specific values of ^1,^2, V3, v^, the 



CAD can represent the feasible domain of {f,Pi,P2,P3) in '^^ as a finite union 
of disjoint cells. Each cell takes the form 



(/,Pl,P2,P3) 

^ 10)4 



/ = flo or ao < / < bo, 

Pi = 9i{f) or giif) <pi< hi{f), 

P2 = 92if,Pi) or g2{f,Pi) <P2< h2{f,pi), 

P3 = 9zU\PuP2) or g3{f,Pl,P2) <P3< h3{f,pi,p2) 



for some constants aQ, bo and some functions Qi, hi, i = 1,2, 3. Since / in- 
dicates the value of the objective function L (or L3), the cell with greatest 
/ provides us the maximum of L. We will illustrate the method with an 
example. 

Suppose Vi = l,f2 = 2,f3 = 3,^4 = 4. Using the software Mathematica, we 
obtain that the maximum of L based on CAD is the negative first root of 
equation -96 + 800x + 5220^2 - 19035x3 + 2187x^ = and 

Pi is the 4th root of equation —2 — 13x + 18x^ + 126x3 + 54x'^ = 0, 
P2 is the 2nd root of equation —2 + 2x + 28x^ — 39x3 _|_ g^4 _ g^ 
P3 is the 2nd root of equation —3 + 13x + 2x^ — 26x3 + 6x^ = 0. 

Here the numerical solution is maxL = 0.1645 with pi = 0.3112, p2 = 
0.2849,p3 = 0.2508, P4 = 0.1531. 

Note that the CAD algorithm can be used to find exact solution for general 
^15^2,^3,^4, although an explicit formula is not available. This technique 
will be used in the next section for robustness study. 

4. Robustness for 2^ Designs 

Since locally optimal designs depend on the assumed values of the parame- 
ters, it is important to study the robustness of the designs to these values. 
For experiments where there is no basis for making an informed choice of 
the assumed values, the natural design choice is the uniform design. In this 
section, we study the robustness of the optimal design for misspecification of 
assumed values. 



Figure 1 : plot of w versus tt 
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J^.l. Robustness for misspecification of w 

Suppose wt = {wti,wt2, Wfs, Wu) is the true w, and w^ = (wci, ^^2, Wcs, Wca) is 
the chosen (assumed) w. Let pt = {pti,Pt2,Pt3,Pt4.) and p^ = {Pci,Pc2,Pc3,Pc4) 
be the optimal designs corresponding to Wf and Wc, respectively. The relative 
loss of efficiency of choosing Wc instead of w^ may be defined as 



R{t, c) 



det{wt, ptY'^ - det{wt, p, 



a/3 



det{wt, Pt 



)l/3 



(3) 



where the notation det{w,p) was defined prior to expression ([T]). Note that 
R{t, c) in equation ([3]) remains invariant under scalar multiplication of de- 
terminants. Now let us define the maximum relative loss of efficiency as 



Rr, 



max 

t 



R{t, c] 



(4) 



This maximum will correspond to the worst case scenario. This tells us, for 
each w, how bad the design can perform if we do not choose the w correctly. 

For a binary response, we consider the commonly used link functions includ- 
ing logit, probit, log- log and complimentary log-log links. Figure [1] illus- 
trates the range of w for specific link functions. The logit link corresponds 
to < tf < 0.25 whereas for the probit link < w < 2/7r and for the (com- 
plementary) log-log links < w < 0.648. It should also be noted that the 



w-curve is symmetric for logit and probit links but asymmetric for the (com- 
plementary) log-log link. To examine the robustness for mis-specification of 
w for different links, we assume < a < w < P for some constants a and /3, 
since w = leads to trivial cases. 

Fixing a chosen Wc = {wci,Wc2, Wcs, Wca), let Vd = l/wd, i = 1,2, 3, 4. With- 
out any loss of generality, we assume Vd < Vc2 < "^cs < v^. It follows 
from Lemma 12.11 that Pd > Pc2 > Pcs > Pd- For the true w^, define 
vt = ivti,vt2,vt3,vti) with vti = 1/wti, i = 1,2,3,4. In practice, the ex- 
perimenter might have some rough idea about the range of the parameter 
values and our next Theorem specifies the worst possible performance of a 
chosen design for that assumed range. 

Theorem 4.1. Suppose < a < f d < f c2 < Vcs < f c4 < & and a < Vu < b, 
i = 1,2,3,4. 

(i) If Vc4 > Vci + Vc2 + Vc3, then -Rmax(c) = 1-3^ (^^) > where 6 = 
b/a > 3, and the maximum can only be attained at Vj = {b,b,b,a). 

(ii) // VcA < Vci + Vc2 + Vc3, then -Rmax(c) can only be attained at Vj = 
{b,a,a,a), {b,b,a,a), or {b,b,b,a). 

If w can be as small as 0, for example, for logistic regression, < u; < 0.25, 
then the upper bound b for v will go to oo. As a direct conclusion from 
Theorem 14.11 we obtain 

Corollary 4.1. Suppose < a < fci < ^c2 < ^c3 < ^'c4 < oo and a < vu < 
oo, z = 1, 2, 3,4. 

(i) If Vci > Vci + Vc2 + Vc3, then i?max(c) = 1. 

(ii) If Vci < Vcl + Vc2 + Vc3, then -Rmax(c) = 1-3 {Pc2Pc3Pc4)^^^ ■ 



To find out the most robust design in terms of maximum relative loss, we 
need explicit formulas of -Rmax(c) for case (ii) of Theorem 14.11 To simplify 
the notations, let q^ = PciPc2Pc3, Qs = PciPc2Pc4, ^2 = PdPcsPa, Qi = Pc2Pc3Pc4- 
Then ^4 > ^3 > ^2 > Q'l- Let 

^ . X ^44^4 + Vt3q3 + Vt2q2 + ^tl^l 

Qc[Vtl,Vt2,Vt3,VtA) 



VtAPtlPt2Pt3 + Vt3PtlPt2Pti + Vt2PtlPt3PtA + VtlPt2PtzPtA 

8 



Then R{t, c) = 1 — Qc{vti^vt2^ "i^ts, ViaY^^ and the -Rmax(c) in case (ii) of The- 
orem 14.11 is 



max 



{l-g,(&,a,a,a)l/^ 1 - g,(6, 6, a, a)^/^^ I - Q,{h,hAaY'^] . 



Let 9 = b/a > 1 and p = \JQ'^ — ^ + 1. Based on Corollary 12.11 and Corol- 
lary | 



f (^gi + g2 + g3 + g4), ife>3 

Qc{h,a,a,a) = Qc(6', 1,1, 1) 

^(^gi + g2 + 93 + ^4), ifl<^<3 
108(e-l)2(^gi+eg2 + g3 + g4) 



ge(&,fe,a,a) = Q,(^,^,l,l) 



i29-l-p){9-2 + p){9 + l + p) 



Qc{b,b,b,a) = Q^{9,9,9,l)=^^^^^{9qi + 9q2 + 9q3 + q,). 

Note that -Rmax(c) is actually a function of Pc = (Pci,Pc2,Pc3,Pc4)- 

Theorem 4.2. Suppose Vd^Vu G [«,&]; ^ = 1,2,3,4, < a < b. Then 
-Rmax(c) attains its minimum if and only if Pc = (1/4,1/4,1/4,1/4), which 
is the uniform design. 

In other words, the uniform design is the most robust one in terms of the 
maximum of relative loss of efficiency. Note that the conclusion of Theo- 
rem U2] is still true even if [a, b] is replaced with [a, oo). 

4-2. Simulation study 

To study the robustness measured by percentiles of {R(t, c)} other than the 
maximum -Rmax(c), we randomly select 1000 vectors Wj = {wii,Wi2,Wi3,Wi4), 
i = 1,2,..., 1000. For the logit link, < Wi < 0.25. If we randomly select 
Wj's between and 0.25, the chance of getting a saturated design can be as 
high as 48% when some Wi is close to and the condition of Theorem 12.11 
applies. We try to skip the cases that give a saturated design since in those 
cases both the exact solution and robustness are clearly known. So here we 
consider w > 0.05 only. Then the chance of saturated design drops to 6% for 
uniformly distributed Wi^s. So, for the logit link, we consider 0.05 < w < 0.25 
and for the other links, 0.05 < w < 0.65. 

9 



Figure 2: Robustness study : performance of the "worst 1%" design 
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Suppose wt = {wti,wt2,wt3,wt4) is the true w, and w^ = (tfci, w^c2, w^cs, w^c4) 
is the chosen (assumed) w. We consider 1000 cases. In our robustness study, 
each one of the 1000 w's is chosen in turn as Wc and the remaining 999 
cases are regarded as wj respectively. We use CAD to determine the optimal 
designs p^ = iPti,Pt2,Pt3,Pu) and Pc = {Pci,Pc2,Pc3,Pc4) corresponding to Wj 
and Wc, respectively. 

For the numerical computations in this section, we consider the upper 99*^ 
percentile of {i?(t, c)}j£°° and denote it by /299(c). This corresponds to the 
worst 1% case scenario. The left panel of Figure [2] illustrates that this relative 
loss will range roughly between 0.1 and 0.4, whereas the right panel helps 
us identify those w's with non-robust optimal solution p. The horizontal 
axis corresponds to the distance between f max and ^ Wj — f max divided by 
Wmax, where Wmax = niax{wi, f 2, W3, f 4}. The vertical axis is our robustness 
measurement i?99. There is a clearly positive association between the relative 
loss and the distance. We have examined the other quantiles such as the 25*^ 
quantile, median, 75**^ quantile, and 95**^ quantile of R{t, c). The patterns are 
similar for all of them. From this, we conclude that the locally D-optimal 
designs are quite robust and the farther the w's are from the saturation 
condition ([2]), the smaller is the relative loss of efficiency. It is interesting to 
note that the left most point (denoted by x ) on the right panel of Figure [2] 
corresponds to the uniform design. It can be verified that the standardized 
distance (2f max ~ X] '^j)/'^max attains its minimum —2 if and only if ^1=^2 = 
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f 3 = f 4 which leads to the uniform design. While the left panel of Figure [2] 
indicates that the performance of the "worst 1%" designs is not too bad in 
terms of robustness, the right panel (as well as figures of other quantiles, not 
shown here) clearly demonstrates the significance of the saturation condition. 
The points with Rgg values greater than 0.15 either satisfy or almost satisfy 
the saturation condition. This figure also suggests that the uniform design 
is highly robust. 

Similar results have been obtained for probit and (complementary) log-log 
links. 

5. Robustness of Uniform Design 

If the experimenter is unable to make an informed choice of the assumed 
values for local optimality, the natural design choice is the uniform design 
Pu = (1/4, 1/4, 1/4, 1/4). The relative loss of efficiency of p„ with respect to 
the true w = {wi, 102,103,104) is: 

det(w,pt)^/^ -det(w,p«)^/^ 
det (w, pt) 

It can be shown that 

D . X . 1/^1 +V2+V3 + VA 

where Vi = l/iOi, pt is the optimal design under w, and L{pt) is defined in 

5.1. Maximum relative loss of uniform, design 

We denote by Rmlx = niax -R„(w) the maximum loss of efficiency of the 

uniform design. The following theorem formulates Rmlx with different values 
of w's and generalizes Theorem 4.1.5 of Mandal, Yang and Majumdar (2010). 
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Theorem 5.1. Suppose < a < w^ < /3, i = 1, 2, 3,4. Let 9 = /3/a > 1. 
Then 



R^J^l 



1-1(1 + 1)'''^ 

^2 \ 1/3 



-me-iy 



2 \ (26»-l-p)(6l-2+p)(6»+l+p) 







ife>3 
ife^<e<3 

ifi<e <e^ 



where p = \J(P' — 6* + 1, and Q^ ^ 1.32 is the 3rd root of the equation 
3456 - 5184^ + 3561^^ + 596^^ - 1506^^ + 100^^ + ^^ = 0. 



(u) 

Figure 3: Plot of i?max versus 9 



Maximum Relative Loss of Uniform Design 




Figure |3] reveals the nature of association between the maximum relative loss 
of uniform design and the ratio between the upper and lower limits of range 
of w's. It can be seen that if the performance of uniform design become worst 
when 9 is 10 or more, but even in that case Rmax is less than 1/4. Note that 
the fact -Rmax < 1/4 was established in Mandal, Yang and Majumdar (2010). 
Uniform design performs moderately well when 6 lies between 3 and 10, and 
it performs extremely well if 6' < 3. 
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5.2. A real example 

The data given in Table [H reported by CoUett (1991), were originally ob- 
tained from an experiment conducted at the East Mailing Research Station 
(Hoblyn and Palmer, 1934). The experimenters investigated the vegeta- 
tive reproduction of plum trees. Cuttings from the roots of older trees of 
the palms named Common Mussel were taken between October, 1931 and 
February, 1932. This experiment involved two factors each at two levels. The 
first factor was time of planting (root stocks were either planted as soon as 
possible after they were taken, or they were imbedded in sand under cover 
and were planted in the next spring). The second factor was the length of 
root cuttings (6 cm or 12 cm). Hoblyn and Palmer used an uniform design 
and a total of 240 cuttings were taken for each of the four combinations. The 
response was the condition of each plant (alive or dead) in October, 1932. 

Table 1: Survival rate of plum root-stock cutting 



Length of 


Time of 


Number of surviving 


cutting 


planting 


out of 240 


Short 


At once 


107 




In Spring 


31 


Long 


At once 


156 




In Spring 


84 



After fitting the logit model, we get, /3 = (-0.5088, -0.5088, 0.7138)' and the 
corresponding w = (0.244, 0.128, 0.221, 0.221)'. If we use this w, the optimal 
proportions are Po = (0.2818,0.1686,0.2748,0.2748)'. The corresponding 
determinant of X'WX is 8.197 x 10^^. On the other hand, the determinant 
of the information matrix corresponding to the uniform design is 7.975 x 10~^. 
Thus the uniform design is (7.975/8.197)^'^ = 99.1% efficient. If this was the 
first of a series of experiments, then the result supports the continued use of 
the uniform design. Similar calculations with the probit link shows that the 
uniform design is 99.9% efficient. 

6. Discussion 

In this paper and our earlier work, Mandal, Yang and Majumdar (2010), we 
have investigated various aspects of locally /^-optimal designs for 2^ exper- 

13 



iments with binary response. Extending these results to experiments with 
more than two factors is far from a straightforward task. The main diffi- 
culty is that a concise expression like (1) is not available. We are currently 
investigating different methods for the general case. For some special cases, 
however, the results can be derived with relative ease. For instance, for the 
1/2 fraction of 2^ given by C = AB, it can be shown that the uniform design 
is locally D-optimal no matter what the assumed values of the parameter 
may be. 



Appendix 



1 . Proof of Theorem \4-l\ 



To simplify the notations, we use (fi,f2, "^3, W4) instead of {vti,Vt2,Vt3,Vt4:) 
here. Note that Qc{\vi, \v2, Xv-s, Xv^) = Qc{vi,V2,V3,V4) for any A > 0. 
Suppose < a < Vi < b, i = 1,2,3,4. To minimize Qc{vi,V2,V3,Vi), we only 
need to consider those cases with v^ = a. 

If Vc4 > Vci + Vc2 + Vc3, then pcA = and pd = Pc2 = Pcz = 1/3. Thus 
Qs = (I2 = Qi = and q^ = 1/27. Fixing 1)4^ = a, it can be verified that 

Qc{vi, V2, V3, a) = ■ ■ ■ > Qc{b, b, b, a), 

W1P2P3P4 + V2P1P3P4 + V3P1P2PA + apiP2P3 

where "=" is true if and only if f 1 = t>2 = f 3 = b. In this case. 



-timax{C) i 



1 /99-1 



2/3 



3^ V 2 

where 6 = b/a. Note that ^ > 3 in this case. 

Suppose VcA < Vci + Vc2 + Vc3- Then pd > Pc2 > Pc3 >Pc4>0 and g4 > gs > 
?2 > 91 > 0. Again, we fix U4 = a and assume < a < f j < 6, i = 1, 2, 3, 4. 

Case 1: If Vi > f 2 + ^3 + a, and then Qc{vi,V2, V3, a) > Qcip, a, a, a), where 
"=" is attained if and only ii vi = b and V2 = V3 = v^ = a. In this case, 
e = b/a> 3. 

Case 2: If fi < V2+V3+a and v[ > Vi, then Qdv'i, V2, V3, a) < Qc{vi,V2,V3, a). 
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Actually, in this case, < pi < p2 < Ps < Pa,- It can be verified that for 
small enough 6 > 0, 

Qc{vi,V2,V3,a) > , , , . , , , , , , , , n-T ^ QcK,^^2,f3,a), 

V1P2P3P4 + V2P1P3PA + V3P1P2PA + aPiP2P3 

where p'^^ = Pi + 6, i = 2,3,4 and p'l = Pi — 36. 

From now on, we only need to consider Qc{b, V2,v^, a) with & > f 2 > f 3 > a 
and h < V2 + V2, + a. In this case, < pi < ^2 < Pa < Pa- 

Similarly, it can be verified that 

(1) lib > V2> a, then Qcih, V2, a, a) > m.m{Qc{b, a, a, a), Qc{b, b, a, a)}. 

(2) If fe > f3 > a, then Qdb, b, V3, a) > m.m{Qc{b, b, b, a), Qcib, b, a, a)}. 

(3) If 6 > ^2 > t'3 > a, then(5c(&, ^2,^3,0) > v[vm{Qc{b,V2,V2,a),Qc{b,V2,a,a)}. 
{A) lib > V = V > a, then Qcip, v, v, a) > m.m{Qc{b, b, b, a), Qcib, a, a, a)}. 

In summary, if Vca < v^ + fc2 + "^cs, then 

Qc{vi, V2, V3, va) > mm{Qc{b, b, b, a), Qc{b, b, a, a), Qc{b, a, a, a)}. 

Based on the proof, the minimum of Qc{vi,V2,V3,Va) can only be obtained 

at {b, a, a, a), {b, b, a, a), or [b, b, b,a)- D 



2. Proof of Theorem \4.2 



Given 9 > 1 and pd > Pc2 > Pcs > Pca, it can be verified that 

^ + 3 



Oqi +q2 + q3 + qA = dPc2Pc3PcA + PclPcSPcA + PclPclPci + PclPc2Pc3 < 



27 



where the second "=" is true if and only if pd = Pc2 = Pc3 = Pca = 1/4. 
Similarly, 6qi + 6q2 + q3 + qA < 27 ' ^here "=" is true if and only if 
Pel = Pc2 = Pc3 = PcA = 1/4; 6qi + 6q2 + Oqs + qA < ^^ where "=" is true if 
and only if pd = Pc2 = Pc3 = Pca = 1/4. Therefore, if Vca < Vci + Vc2 + Wcs, 

min [Qcib, a, a, a), Qcib, b, a, a), Qcib, b, b, a)} 

attains its maximum only at pd = Pc2 = Pc3 = Pca = 1/4. In other words, 
the uniform design has smaller -Rmax(c) than any other design Pc with Vca < 

Vd + Vc2 + Vc3- 
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On the other hand, it can be verified that if ^ > 3, the maximum relative 
loss of uniform 

for any design with v^ > fci + Vc2 + fcs- 

In short, -Rmax(c) attains its minimum only at the uniform design. D 

3. Proof of Theorem EH] 

Let e = 13 /a (or h/a) > 1 and p = ^/O"^ -6 + 1. Then 

Qi :=Q(6,a,a,a) = Q(^, 1, 1, 1) = <^ {e+z){9-e)^ ' if 1 < ^ 
Q2:=Q{h,h,a,a) = QiO, 9,1,1) 

Q-s:=Q{b,b,b,a) = Qie,e,e,i) 



e<3 

216(^ + l)(^-l)2 



{2e-i-p){e-2 + p){e + i + p) 

{39 + l){99-iy 



4^3 

Since 6' > 1, it can be verified that Q^ > Q2 and the "=" is true if and only 
if 6* = 1, that is, a = b. Thus m.in{Q{b,b,b,a),Q{b,b,a,a),Q{b,a,a,a)} = 
m.m{Q{b, b, a, a), Q{b, a, a, a)}. 

Now we only need to compare Qi = Q{b,a,a,a) with Q2 = Q{b,b,a,a). It 
can be verified that 

(i) if^ = i, ore = 0„gl = g2• 
(ii) If 1< ^ < ^„ Qi > Q2. 

(ill) If ^ > 9^, then Qi < Q2- 

Here 9^, ^ 1.32 is the 3rd root of equation 

3456 - 5184^ + 3561^^ + 596^^ - 1506^^ + 100^^ + ^^ ^ . 

Then i?max can be obtained accordingly. n 
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